Unlock the task bar by right clicking on a blank area. Now you can easily drag icons off or on the task bar.